(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 
International Bureau 

(43) International Publication Date 
18 January 2001 (18.01.2001) 




PCT 



(10) International Publication Number 

WO 01/04838 Al 



(SI) International Patent Classification 7 : G06T 11/00 
(21) International Application Number PCT/EP0O/054O7 



(22) International Filing Date: 

(25) Filing Language: 

(26) Publication Language: 



9 June 2000 (09.06.2000) 
English 
English 



(30) Priority Data: 
60/142,600 



7 July 1999(07.07.1999) US 



(71) Applicant (for AE, AU. BB, CA. CY. GB. GD. GH, GM, IE, 
IL. KE, LC. LK LS. MN. MW, MZ NZ SD. SG. SL, SZ 
TT. TZ UG, ZA. ZW only): UNILEVER PLC [GB/GB]; 
Unilever House, Biackfriars. London EC4P4BQ (GB). 

(71) Applicant (for all designated States except AE, AU BB, 
CA, CY, GB, GD, GH, GM, IE IL, IN. KE, LC. LK LS, 
MN.MW.MZ SZ. SD. SG. SL. SZTT.TZ UG, ZA. ZW): 
UNILEVER NV [NL/NLJ; Weena 455, NL-3013 AL Rot- 
terdam (NL). 



(71) Applicant (for IN only): HINDUSTAN LEVER LIM- 
ITED [IN/IN]; Hindustan Lever House. 165/166 Backbay 
Reclamation, Mumbai 400 020, Maharashtra (IN). 

(72) Inventor: FLYNN, Madeline, Deraayo. Elizabeth Arden 
Co., 40 Merrill Boulevard, Trumbull, CT 066 1 1 (US). 

(74) Agents: ROTS, Maria, Johanna, Francises et al.; 
Unilever PLC, Patent Department, Cot worth House, 
Shambrook, Bedford, Bedfordshire MK44 ILQ(GB). 

(81) Designated States (national): AE, AL, AM, AT. AU, AZ, 
BA. BB. BG. BR, BY. CA. CH, CN, CR, CU. CZ, DE DK, 
DM. EE, ES, FI. GB. GD. GE GH, GM, HR. HU, ID. IL, 
IN, IS, JP. KE, KG, KP. KR, KZ. LC, LK, LR. LS, LT. LU, 
LV, MA, MD. MG. MK, MN, MW, MX, NO. NZ, PL, PT, 
RO, RU, SD. SE, SG, SL SK, SL, TJ, TM, TR, TT, TZ. UA, 
UG, UZ, VN, YU. ZA. ZW. 

(84) Designated States (regional): AR1PO patent (GH, GM, 
KE, LS. MW, MZ. SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD. RU. TJ, TM), European 
patent (AT. BE, CH. CY, DE, DK. ES. FI, FR. GB. GR, IE, 

[Continued on next page] 



(54) Title: A SYSTEM FOR COLOUR COSMETIC SELECTION 




msa ixnra 
fmmu 



ammo / >v 

OWE ICI0 

MDSDOI • 


KUHOCO 


1 \ \ 


«• 1 


nociim 

nssnr 



00 
fO 

£ (5*0 Abstract: A method and system is provided for selecting a facial colour cosmetic scheme. Apparatus employed for the sys- 
S tern includes a computer module with a colour monitor screen, a spectrophotometer for measuring a customer's skin colour and a 

device for transferring the measured colour information from the spectrophotometer to the computer module for entry into a pro- 
J gram allowing visualisation of a model face with skin colour matched to that of the customer. The method includes measuring via 

spectrophotometer a customer's facial colour, rxansmming information on that colour to the module for display on the model face 
Q appearing in the monitor, allowing the customer to select at least one colour for an area of the face to be covered by a cosmetic prod* 
^ uct. and then displaying the visualised model face with the selected colour. The system and method allow a customer to visualise 
^ the colour combination without the necessity of using the actual colour cosmetic on their own face for evaluation purposes. 
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A SYSTEM FOR COLOUR COSMETIC SELECTION 



Field of the Invention 

5 

The present invention relates to a method and implementing 
apparatus for assisting a customer in selecting colour cosmetic 
products . 

10 BACKGROUND OF THE INVENTION & PRIOR ART 

Colour cosmetics are highly personal to an individual. An optimum 
shade is selected having relevance to a customer's skin coloration 
and to a colour fancied by the customer. 

15 

Assistance in the selection of an optimal colour shade is 
available to help the consumer. Clinque and Clarion have 
installed computers at sales counters for use by customers. 
Information on colour, shade, oiliness and other properties of a 

20 customer's skin are punched into the computer which then 
determines the company's most closely matching product. Two major 
companies, Prescriptives (Division of Estee Lauder) and Visage 
(Division of Revlon) have for some time practiced a manual system 
for evaluating a subject's skin colour. The sales person is 

25 trained through the use of match cards to identify a user's 
matching skin foundation. Unfortunately manual systems suffer 
from poor reproducibility. Extensive training must also be 
invested in a sales person. 

30 German patent 41 10 299 CI (Erdtmann) discloses the use of a 
facial sensor for reading skin property values and then utilising 
the measured values in selecting an optimum skin product. 
Subsequently, the information is sent to an automatic cosmetic 
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dispensing system for blending selected additives to formulate the 
selected product. 

U.S. Patent 5,622,692 (Rigg et al.) reports a system for 
customising a facial foundation product at point of sale to a 
customer. Three essential elements are present. They include a 
skin analyser for reading skin properties, a programmable device 
receiving the reading and correlating it with an optimal formula 
and a formulation machine for preparing the facial foundation 
product from various cosmetic chemical compositions. Technology 
described in this patent has commercially been embodied in 
Elizabeth Arden' s Custom Colour system available for many years in 
major department stores. 

Arden' s system has been a significant advance in the art. 
However, it suffers from certain deficiencies, including the 
inability of customers to evaluate different colour cosmetics in 
the context of their own skin colouration, and in juxtaposition to 
combinations of different facial makeover products. Thus it would 
be desirable to have visualised a lipstick and a foundation, eye 
shadow and/or blush on a colour interactive basis. Especially 
desirable would be to evaluate the interaction of the various 
colour cosmetics without actually having to place these on one's 
own face. 

Accordingly, it is an advantage of the present invention to 
provide a system and apparatus for selecting a facial colour 
cosmetic scheme from a palette of different shades and makeup 
products without requiring the actual placement of these products 
on the customer's face. 

• Another advantage of the present invention is to provide a system 
and apparatus for selecting a facial colour cosmetic scheme 
allowing rapid visualisation of different coloured makeup 
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permutations on various areas of the face in a simultaneous 
manner. 

SUMMARY OF THE INVENTION 

The present invention provides a method for selecting a facial 
cosmetic colour scheme, the method including: 

(i) providing a computer module including a color monitor 
screen and a spectrophotometer; 

(ii) measuring a customer's facial colour with the 
spectrophotometer; 

(iii) transmitting information on the measured facial 
colour to the computer module for display of . that 
colour on a model face generated on the monitor 
screen; 

(iv) allowing the customer to select at least one area of 
the face to be coloured with a colour cosmetic 
product; and 

(v) colouring the area of the model face with the 
selected colour. 

Optionally, a further step may be added involving printing on 
paper the coloured display from step (v) appearing on the monitor. 
By this method, a customer can select eye shadow, eye liner, 
lipstick, lip liner, blush, foundation and/or powder with selected 
colours, at least some of the combination having been first 
evaluated on a model face generated on the computer monitor 
screen. A program controlling the colour and selection scheme can 
further be included to correlate a vendor's products which will 
achieve the selected colour palette. 

• According to a further aspect, the present invention provides a 
system for selecting a facial colour cosmetic scheme, the system 
including: 
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(i) 



a computer module connected with a colour monitor 



screen; 



(ii) 



a spectrophotometer for measuring skin colour; 



(iii) a mechanism for transfer of facial colour data 
obtained from measurements with the spectrometer over 
to the computer module and transmission onto the 
monitor screen; and 

(iv) an interactive program displayed on the monitor 
allowing the customer to select at least one colour 
for application to an area of a model face appearing 
on the monitor. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The various objects, features and advantages of the present 
invention will become more readily apparent from consideration of 
the following drawing in which: 

Fig. 1 shows a flow chart diagramming a program used in the 

system of the invention for selecting facial colour cosmetic 
schemes; 

Fig. 2 shows Screen 2 of the program; 

Fig. 3 shows Pop-Up Screen 3 of the program; 

Fig. 4 shows Pop-Up Screen 4 of the program; 

Fig. 5 shows Overlay 5 of the program; 
Fig. 6 shows Screen 6 of the program; 



Fig. 7 shows Overlay 7 of the program; 
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Fig, 8 shows Pop-Up Screen 8 of the program; 

Fig. 9 shows Pop-Up Screen 9 of the program; 

Fig. 10 shows Pop-Up Screen 10 of the program; 

Fig. 11 shows Pop-Up Screen 11 of the program; 

Fig. 12 shows Pop-Up Screen 12 of the program; 

Fig. 13 shows Pop-Up Screen 13 of the program; 

Fig. 14 shows Pop-Up Screen 14 of the program; 

Fig. 15 shows Overlay Screen 15 of the program; 

Fig. 16 shows Pop-Up Screen 16 through 19 of the program; 

Fig. 17 shows Pop-Up Screen 20 of the program; 

Fig. 18 shows Pop-Up Screen 21 of the program; 

Fig. 19 shows Pop-Up Screen 22 of the program; 

Fig. 20 shows Pop-Up Screen 23 of the program; 

Fig. 21 shows Screen 24 of the program; 

Fig. 22 shows Overlay 25 of the program; and 

Fig. 23 shows a printout of a stylised model face provided 
as a printout from the method according to the present invention 
including recommendation for various different types of colour 
cosmetics. 
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DETAILED DESCRIPTION OF THE INVENT I OH 

Now it has been found that a customer can evaluate how different 
colour cosmetics can interact by first visualising different 
colours on different areas of the face through computerised 
painting of a model face upon a monitor screen. In this system a 
customer is allowed to select colours to be placed on different 
areas of the model face. A reiterative procedure then occurs. 
This involves the customer selecting a colour, having the program 
paint the selected colour onto the stylised model face and then 
allowing the customer to evaluate the result. No longer must a 
customer actually try the product on his or her own face. A very 
rapid and clean evaluation can occur through use of the visualised 
model face. 

A customer' s actual facial colour can be measured by a 
spectrophotometer/colorimeter of a type having a visible light 
source, such as light emitting diodes (LED), xenon-arc, tungsten- 
halogen and similar type in the wavelength range of 400-900 nm. 
The visible light source may form the sensor portion of the 
spectrophotometer/colorimeter. Both visible and infrared 

wavelength light may be utilised in connection with the sensor 
portion. Suitable skin analysers are commercially available from 
Minolta Camera Co. Ltd., Japan and from Colortec Associates. 
Actual skin colour normally is measured around neckline areas 
which are free of a customer's foundation or other cover-up 
cosmetics . 

Measurement starts by cleaning the areas preparatory to a reading. 
* The spectrophotometer/colorimeter is then placed in proximity to 
the cleaned facial area. Visible light emitted in the 400-900 nm 
range by the device will be reflected off the skin surface and the 
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reflective wavelength measured. It is recommended that at least 
five skin readings along the neck/ jaw line region be taken. Total 
time for the reading requires approximately 30 seconds. A cable 
connecting the spectrophotometer/colorimeter to the computer 
module transmits the measured information on L, a and b thereby 
inputting a customer' s natural skin colour parameters into the 
database. Alternatively the measured values can be read by the 
measuring consultant directly off of the 

spectrophotometer/colorimeter and manually banked into the 
computer module by typing the information on a linked keyboard. 

By the term "computer module" is meant any programmable device 
capable of processing information. Normally these are personal 
computers . 

Fig. 1 is a flow chart of a program according to one embodiment of 
this invention. After the opening screen, a user is introduced to 
Screen 2 known as the 'customer session' . Client information is 
obtained via this screen through either a swipe card, entry via a 
keyboard or from a database. The screen remains active (buttons 
are available) when overlays are displayed. Fig. 1 provides a 
view of Screen 2. 

A Pop-up Screen 3 next appears with comments and client 
information to prompt follow-up calls. This screen can be used 
for contacting the client to remind them to visit the store when 
their cosmetic supply may be low. Fig. 3 illustrates the screen. 

Pop-up Screen 4 covering 'Maintenance' is then available for 
appearance. This pop-up screen has options for calibration and 
data handling. Fig. 4 sets forth the screen. 

Other information is collected with Overlay Screen 5. The Overlay 
screen selects/changes information about skin, beauty habits, type 
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and brand of products used. Overlay Screens 2 and the buttons on 
Screen 2 remain active. Fig. 5 describes Overlay Screen 5. 

Screen 6 provides a 'Consultant' s Choice'. This screen shows 
effects of colour palette, using client's skin colour. 
Information on the client's skin colour is obtained through 
application of a hand-held spectrophotometer against areas of the 
face not likely to be covered by makeup. These areas include the 
neck and under chin areas. The cosmetic 'look' can either be 
based on skin colour (skin recommendation), lipstick colour 
(colour family), or a specific look. Depending on selections, a 
list of typically five 'looks' is created, and selecting (another 
look) displays next look in the series. Fig. 6 sets forth Screen 
6. 

Purchase information is achieved in Overlay Screen 7. This screen 
with previous and current purchase information (overlay to screen 
2) is ordered by visit date. It contains information from up to 
the last five visits. Purchase information includes number, 
product type, product name and product number. Fig, 7 sets forth 
the purchase information screen. 

Pop-up Screen 8 measures skin colour. It consists of a series of 
screens to assist an adviser with colour measurement. This 
session is repeated three times. Fig. 8 depicts the Pop-up Screen 
8. 

Pop-up Screen 9 serves to obtain information for a new store. It 
is used by the installation team to correctly set up the store- 
specific parameters. Fig. 9 describes the Pop-up Screen 9. 

• Collection of data for the main office is found in Pop-up Screen 
10. Data is placed in a store's outbox, and can then be 
transferred in three ways. These include: (1) remote computer can 
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dial in and retrieve file from outbox; (2) transfer information to 
a server automatically using PC-anywhere script; and/or (3) copied 
to floppy disk and mailed to central site. Fig. 10 illustrates 
the Pop-up Screen 10. 

Pop-up Screen 11 copies data from other stores. It can accept 
data in two ways. These include: (1) update using floppy supply 
by the main office; or (2) use of PC/Anywhere script to retrieve 
update file from main office outbox. Fig. 11 illustrates the Pop- 
up Screen 11. 

Pop-up Screen 12 allows selection of a colour lipstick family. 
The customer advisor can either enter a specific lipstick number, 
or choose a colour family, then choose a colour from the family. 
The active colour palette will consist of individual palettes that 
contain that lipstick. The advisor can also enter a specific look 
(can be either from a previous visit or any of the available looks 
in the palette). Fig. 12 describes the pop-up Screen 12. 

Pop-up Screen 13 allows selection of lipstick from a colour family 
(as selected from Pop-up Screen 12) . If the lipstick is also in 
the palette recommendation based on skin tone, the colour is put 
first in the list, and (expert fit) is added to the name. Fig. 13 
describes the Pop-up Screen 13. 

Pop-up 14 shows product selections (treatments in cosmetic 
colours) made during the present session. Product selections can 
be made during colour viewing (Screen 6) , treatment/product 
options (Overlay 24) or Recommended Foundation (Pop-up Screen 20) . 
There also is a display of recommended looks. Fig. 14 describes 
the Pop-up Screen 14. 

Overlay Screen 15 is used to provide a snapshot of the type of 
customer. For detail purchase history, Overlay 7 provides the 
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purchase information. Included in this screen are key purchase 
properties, group by type, over the past twelve months. It is 
automatically displayed for each customer. Fig. 15 lists the 
Overlay Screen 15. 

Pop-up Screen 16 is a probe for calibration/routine and for 
messages to calibrate probe. Fig. 16 details the Pop-up Screens 
16-19. 

Pop-up Screen 20 is used to recommend the best foundation product 
combination based on skin colour and product preferences. Fig. 17 
details the Pop-up Screen 20. 

Pop-up Screen 21 is an advanced data management module. This is 
used by the main office. Fig. 18 details the Pop-up Screen 21. 

Pop-up Screen 22 relates to language selection. Fig. 19 details 
Pop-up Screen 22. 

Pop-up Screen 23 is used to locate and activate a client. If this 
is a new client, the 'new' button is clicked to create the new 
client file. Fig. 20 details Pop-up Screen 23. 

Screen 24 details treatment/colour/fragrance options showing all 
the option products. Fig. 21 details Screen 24. 

Overlay 25 focuses on skin colour analysis allowing selection of 
shade and tone. Fig. 22 details the Overlay 25. 

The foregoing description illustrates selected embodiments of the 
present invention. In light thereof variations and modifications 
will be suggested to one skilled in the art, all of which are 
within the scope of this invention. 
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CXAXMS: 

1. A method for selecting a facial colour cosmetic scheme, the 
method comprising: 

(i) providing a computer module including a colour 
monitor screen and a spectrophotometer; 

(ii) measuring a customer's facial colour with the 
spectrophotometer; 

(iii) transmitting information on the measured facial 
colour to the computer module for display of that 
colour on a model face generated on the monitor 
screen; 

(iv) allowing the customer to select at least one area of 
the face to be coloured with a colour cosmetic 
product; and 

(v) colouring the area of the model face with the 
selected colour. 

2. The method according to claim 1 further comprising the steps 
of printing in colour on paper the displayed model face via a 
printer. 

3. The method according to claim 1 or claim 2 wherein areas of 
the face to be coloured are those selected from the lips, 
eyelashes, eyelid, cheeks and combinations thereof. 

4. The method according to any of the preceding claims wherein 
a proigram operated by the computer module stores information on a 
vendor's products which will achieve the selected colour when 
placed upon the selected area of the face. 

.5. A system for selecting a facial colour cosmetic scheme, the 
system comprising: 
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(i) a computer module connected with a colour monitor 
screen; 

(ii) a spectrophotometer for measuring skin colour; 

(iii) a mechanism for transfer of facial colour data 
5 obtained from measurements with the spectrometer over 

to the computer module and transmission onto the 
monitor screen; and 

(iv) an interactive program displayed on the monitor 
allowing a customer to select at least one colour for 

10 application to an area of a model face appearing on 

the monitor. 
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FIG. 4 
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FIG. 8 
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FIG. 12 
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FIG. 17 
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